Papers with Graph Neural Network
Detecting Sexism in Tweets: A Sentiment Analysis and Graph Neural Network Approach (2025.naacl-srw)
Copied to clipboard
Diana P. Madera-Espíndola, Zoe Caballero-Domínguez, Valeria J. Ramírez-Macías, Sabur Butt, Hector Ceballos
| Challenge: | a new tool to detect sexism on social media platforms is being developed to identify such behavior . sexist ideologies such as sextism and gender-based violence can be spread through social media . |
| Approach: | They propose to use BERT and GraphSAGE to analyze tweets for sexism detection . they also use sentiment analysis and natural language processing techniques to classify tweets . |
| Outcome: | The proposed tool analyzes tweets for sexism detection and classifies them into five categories. |
Generating Logical Forms from Graph Representations of Text and Entities (P19-1)
Copied to clipboard
| Challenge: | Recent approaches to semantic parsing have cast it as a sequence-to-sequence task, with strong results. |
| Approach: | They propose a Graph Neural Network architecture to incorporate information about relevant entities and their relations during parsing. |
| Outcome: | The proposed approach outperforms the state-of-the-art in several tasks without pre-training and outperformed existing approaches when combined with BERT pre-trainment. |
An Experimental Analysis on Evaluating Patent Citations (2024.emnlp-main)
Copied to clipboard
| Challenge: | Graph Neural Networks (GNNs)-based methods can predict patent citations using only patent text. |
| Approach: | They propose to use Graph Neural Networks to predict citations for patents based on their semantic similarities to generate a semantic graph of patents. |
| Outcome: | The proposed methods produce 94% recall for patents with high citations and outperform baselines. |
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)
Copied to clipboard
Paiheng Xu, Gang Wu, Xiang Chen, Tong Yu, Chang Xiao, Franck Dernoncourt, Tianyi Zhou, Wei Ai, Viswanathan Swaminathan
| Challenge: | Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs. |
| Approach: | They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides. |
| Outcome: | The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation. |
KGPool: Dynamic Knowledge Graph Context Selection for Relation Extraction (2021.findings-acl)
Copied to clipboard
Abhishek Nadgeri, Anson Bastos, Kuldeep Singh, Isaiah Onando Mulang’, Johannes Hoffart, Saeedeh Shekarpour, Vijay Saraswat
| Challenge: | Existing methods for relation extraction (RE) use only expanded facts from the knowledge graph . |
| Approach: | They propose a method for relation extraction from a single sentence . they use a neural network to expand the context with additional facts from the KG . |
| Outcome: | The proposed method is more accurate than state-of-the-art methods on standard datasets. |
When Will the Tokens End? Graph-Based Forecasting for LLMs Output Length (2025.acl-srw)
Copied to clipboard
Grzegorz Piotrowski, Mateusz Bystroński, Mikołaj Hołysz, Jakub Binkowski, Grzegorz Chodak, Tomasz Jan Kajdanowicz
| Challenge: | Large Language Models (LLMs) are typically trained to predict the next token in a sequence. However, their internal representations encode signals that go beyond immediate next-token prediction. |
| Approach: | They propose an aggregation-based model that combines hidden states from multiple transformer layers l 8, dots, 15 using element-wise operations such as mean or sum. |
| Outcome: | The proposed model reduces NMAE by over 50% on the Alpaca dataset. |
Let’s Ask GNN: Empowering Large Language Model for Graph In-Context Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured data. |
| Approach: | They propose a novel approach that leverages In-Context Learning to integrate graph data and task-specific information into large language models (LLMs) they employ a Graph Neural Network-powered structure-enhanced retriever to select labeled nodes across graphs, incorporating complex graph structures and their supervision signals. |
| Outcome: | Experiments on three tasks and seven LLMs show that AskGNN performs better than existing methods. |
Graph-Based Multilingual Label Propagation for Low-Resource Part-of-Speech Tagging (2022.emnlp-main)
Copied to clipboard
| Challenge: | Part-of-Speech (POS) tagging is an important component of the NLP pipeline, but many low-resource languages lack labeled training data. |
| Approach: | They propose a method for transferring labels from high-resource sources to low-resourced target languages using a graph-based label propagation method. |
| Outcome: | The proposed method achieves state-of-the-art for unsupervised POS tagging of low-resource languages. |
Exploiting Abstract Meaning Representation for Open-Domain Question Answering (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work attempts to address these challenges using Pretrained Language Models (PLMs) but the diversity of surface form expressions can hinder the model’s ability to capture accurate correlations, especially when the context is lengthy and complex. |
| Approach: | They propose a method known as Graph-as-Token (GST) to incorporate AMRs into PLMs to assist the model in understanding complex semantic information. |
| Outcome: | The proposed method outperforms existing methods and significantly improves performance on both Natural Questions and TriviaQA. |
Discovering Dialog Structure Graph for Coherent Dialog Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies on dialog structure graphs from open-domain dialogs have limited number of dialog states and can be laborious and costly to annotate manually. |
| Approach: | They propose to use dialog structure graph as a model to discover hierarchical latent dialog states and their transitions from corpus to facilitate dialog management in a RL based dialog system. |
| Outcome: | The proposed model can discover meaningful dialog structure graph and significantly improve multi-turn coherence on two benchmark corpora. |
Article Classification with Graph Neural Networks and Multigraphs (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing and newly published articles require complex and complex pipelines to classify them into context-specific label taxonomies. |
| Approach: | They propose to enrich Graph Neural Network pipelines with multi-graph representations that encode multiple signals of article relatedness as distinct edge types. |
| Outcome: | The proposed methods improve the performance of a variety of GNN models compared to default graphs. |
Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Existing taxonomies are either entirely absent or missing. |
| Approach: | They propose a GNN-based cross-domain transfer framework for the taxonomy construction task. |
| Outcome: | The proposed framework improves on benchmark datasets from science and environment domains. |
Iterative GNN-based Decoder for Question Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models ignore the rich structure information that is hidden in the previously generated text. |
| Approach: | They propose to model the previous generation using a Graph Neural Network at each decoding step. |
| Outcome: | The proposed model outperforms the state-of-the-art models with sentence-level QG tasks on SQUAD and MARCO datasets. |
GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit strong In-Context Learning (ICL) capabilities when prompts with demonstrations are used. |
| Approach: | They propose a prompt-based parameter-efficient fine-tuning approach that leverages insights into ICL’s information flow dynamics and hardwires the desired information flow into the GNN. |
| Outcome: | The proposed approach surpasses prompt-based fine-tuning methods in few-shot settings by updating just 0.2% to 0.5% of parameters. |
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN (2022.naacl-main)
Copied to clipboard
| Challenge: | During a conversation, a person’s emotions are influenced by the other speaker’s utterances and their own emotional state over the utterrances. |
| Approach: | They propose a Graph Neural Network based Multi-modal Emotion recognitioN system that leverages local and global information in a conversation. |
| Outcome: | The proposed system gives state-of-the-art results on IEMOCAP and MOSEI datasets and detailed ablation experiments show the importance of modeling information at both levels. |
DRLK: Dynamic Hierarchical Reasoning with Language Model and Knowledge Graph for Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work only uses the same QA context representation to interact with multiple layers of KG, which results in a restricted interaction. |
| Approach: | They propose a model that utilizes dynamic hierarchical interactions between QA context and KG for reasoning. |
| Outcome: | The proposed model performs state-of-the-art on two benchmark datasets and competitively on the others. |
Breadth First Reasoning Graph for Multi-hop Question Answering (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent Graph Neural Network (GNN) has been used as a promising tool in multi-hop question answering task. |
| Approach: | They propose a model of Breadth First Reasoning Graph that passes to next nodes hop by hop until all edges have been passed. |
| Outcome: | The proposed model achieves state-of-the-art on answer span prediction on hotpotQA leaderboard. |
HeterGraphLongSum: Heterogeneous Graph Neural Network with Passage Aggregation for Extractive Long Document Summarization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models for extractive document summarization are based on sequence-to-sequence (Seq2Sequency) but long-form document summaries using graph-based methods are still an open research issue. |
| Approach: | They propose a heterogeneous graph neural network model to improve the performance of extractive document summarization using graph-based methods. |
| Outcome: | The proposed model can achieve state-of-the-art performance without pre-trained language models. |
Transforming Visual Scene Graphs to Image Captions (2023.acl-long)
Copied to clipboard
Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Songfang Huang, Fei Huang, Zhangzikang Li, Yu Zhang
| Challenge: | Existing approaches to generate captions using image captioning are based on multi-head attention (MHA) |
| Approach: | They propose to transform scene graphs into more descriptive captions by using multi-head attention to build a Graph Neural Network (GNN) . they construct a Mixture-of-Expert (MOE)-based decoder where each expert is built on MHA for discriminating the graph embeddings to generate different kinds of words. |
| Outcome: | The proposed framework can generate captions from multiple visual features and objects . it is based on a mixture-of-expert (MOE)-based decoder based upon MHA . |
iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models suffer from factual inaccuracies in knowledge-intensive domains. |
| Approach: | They propose a question-guided KBQA framework that iteratively decomposes complex queries into simpler sub-questions and integrates a Graph Neural Network (GNN) to look ahead and incorporate 2-hop neighbor information at each reasoning step. |
| Outcome: | The proposed framework improves on four benchmark datasets and four LLMs. |
GeoDRL: A Self-Learning Framework for Geometry Problem Solving using Reinforcement Learning in Deductive Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for automated geometry problem solving lack labeled data. |
| Approach: | They propose a framework that integrates logic graph deduction and deep reinforcement learning to optimize geometry reasoning as a Markov Decision Process. |
| Outcome: | The proposed framework improves accuracy and interpretability in the Geometry3K dataset while maintaining correctness. |
MAGIC-VQA: Multimodal And Grounded Inference with Commonsense Knowledge for Visual Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing Large Vision-Language Models (LVLMs) lack integrated commonsense knowledge . lack of integrated common knowledge limits their robustness and accuracy in VQA . |
| Approach: | They propose a framework to enhance multimodal inference by integrating commonsense reasoning. |
| Outcome: | MAGIC-VQA improves comprehensive benchmark datasets, surpassing existing models in tasks requiring advanced commonsense reasoning. |